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OVERVIEW OF OBJECTIVES AND OUTCOMES 
OF THE SCHOOL PERSONNEL UTILIZATION EVALUATION 



OVERVIEW Ot' OBJECTIVES AMD OUTCOMES 
OF THE SCHOOL PERSONNEL UTILIZATION EVALUATION 

The Evaluation Training C«nc«r at Florida State Unlverilty was 
e«t..bllfihed und«r a grant from the School Paraonnal Utilization Prograar 
of the Bureau of Educational paraonnal Devalopmant, U. S. Office of 
Education. Thl» grant was administered by the State of New Jersey, 
Department of Education, Division of Research, Planning, and Evaluation 
through the Educational Improvement Center, Pitman, New Jersey, and sub- 
contracted to Florida State University. 

During the funding year, 1970-71, the Evaluation Training Center at 
Florida State University planned and implemented strategies which have 
resulted In the achievement of all major objectives for which funds were 
granted. Volume I of this report is intended to give the reader an under- 
standing of the scope of the project, an introduction to the functioning 
of the Evaluation Training Center, and a summary of the major findings of 
the evaluative studies. Volumes II through IV describe in detail Center 
activities relevant to the fulfillment of each ETC objective under the 
School Personnel Utilization contract. 

The contract between the Evaluation Training Center and the U. S. 
Office of Education required the following: 

1. The development of a graduate training program in the evalu- 
ation of School Personal Utilisation Programs. 

2. An analysis and revision of the SPU Program objectives. 

3. The development of instruments and procedures and the subse- 
quent training of project evaluators required to assess the 
impact of the SPU Program. 

A. The development of a comprehensive model for evaluating 
School Personnel Utilisation Programs. 

5. Extensive field testing of the evaluation model in a 
selected sample of projects. 

6. A summary report on the evaluation of SPU projects. 



Part 1 

Graduate Training In Evaluation 

In July, 1970, the Department of Educational R«aaarch designed a 
course of instruction geared especially to the needs of individuals 
Involved in an evaluation of School Personnel Utilization Projects, estab- 
lished an Evaluation Training Center, and alnca that time haa provided 
both theoretical and practical learning experiances. Throughout Its first 
year, the Evaluation Training Center has operated with eleven graduate 
student trainees, seven of which were funded through Spu Tralneeshlps, 
one full-time and two fractional faculty poalti^os, and secretarial help. 

The rationale for establishing an Evaluation Training Center to 
develop talent for evaluating School Personnel Utilisation projects was 
based on the belief that this type of evaluatlpn required learning oppor- 
tunities not commonly found in graduate reaearch programa. For one thing, 
there was the necessity of wedding research mechodolPgy with the pragmatics 
of school staffing and related Innovationa. For another, there was the 
problem of providing ev^aluation training in addition to the department's 
ongoing training for educational researchera. bring these three con* 
cerns together in a training program, tralneea tha Canter were involved 
in three phases of activity. The first phase of the Program was accom-- 
pllshed by enrolling each Center trainee In tha Educational Research 
Department's core requirements. Here, instruccion m research methodology, 
measurement competencies, and statistical applications was provided. In 
addition to this, trainees were Involved in spacific couraework in the 
theory of evaluation and spent half-time invoivad In supervised Center 
activities where the application of that knowla^ge lO a real setting was 
possible. Finally, the third phase requlremenca wera satlafled by 
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providing trainees training in the theory behind organizational stru.tuia; 
innovations and by getting them Involved in echool settings whtre ;nr, ra- 
tion and development were taking place. 

The Center has attempted to offer trainees a progr^ geared to spe- 
cific needs, and therefore each trainee has been participating in an 
individualized program. For the sake of this report, individual progiar.;^ 
were considered and the following list of activities and coursework repre- 
sents a .'airly typical training schedule: 

Approximate 
Student Contact 
Topic or Activity Hours 

!• Evaluation Theory and Practice 

a. Seminar in Educational Field Research (EDR 526) aO 

b. Theory of Evaluation (EDR 502) 30 

c. Supervised Evaluation Practlcum 

1) Design of components of Evaluation Model ..... 80 

2) Developing instruments for the Model 200 

3) Group planning of on-site evaluations 60 

4) On-site evaluation activities 

5) AnalyFls, interpretation, and reporting of data , 250 

6) Revision of evaluation instruments and procedures.... lOO 

2. Educational Innovations 

a. Structural Organizational Alternatives , . . 30 

b. Seminar in Alternative Approaches to School Personnel 
Utilization (EDR 605R) , 30 

c. Instructional Design Models (EDR 631) ] . . ! . 30 

d. Supervised Practlcum in Planning for Educational Change 30 

1) Development of Staff-use models 130 

2) Visitation in Innovative schools 20 

3) Development of accountability models lOO 

4) Design of Instructional system (,0 

3. Topics in Educational Research 

a. Methods of Educational Research (EDR 520) 40 

b. Operational Objectives in Educational Research (EDR 543). ... ... io 

c. Advanced Topics In Educational Research (EDR 525) . 30 

d. Statistical Applications in Education: Description and Basic 
Inference (EDR 510) 50 

e. Advanced Statistical Application in Education: Analysis of 
Variance and Covarlance, Regression (EDR 511). i 50 

f. Applications of Nonparametrlc Statiatlcs (EDR 513) 30 

g. The Use of Tests In Teaching and Guidance (EDR 501) 40 

Total 1,530 
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explaln the ETC Conceptual Model, describe the eveluetlon design, and 
instruct project personnel in the data collection procedures they snort 1> 
would be involved in. 

At the LTI institute, the Evaluation Training Center sponsored train- 
ing consisting of: 

Contact Number of 

Topic Hours Participants 

Presentation and explanation of the 1 60 

conceptual model of School 
Personnel Utilisation 

Training in self*assessment techniques 2 33 

Training in the use of instruments 1 35 

developed by ETC for the SPU evalua- 
tion design 

Explanation of the evaluation design 1 60 

being developed 

The seconu opportunity ETC had to provide training at the project level 
was during the on-site evaluation of five projects* Inherent in the evalu- 
ation design was involvement of school personnel in the evaluation process, 
and the principle of immediate feedback to project personnel. Since the 
evaluation design required an analysis of each project's staffing mode^ 
and plan for Implementing that model, the on-site visit provided an 
excellent opportauity to present alternative model building and planning 
strategies to project personnel who may not have been previously trained 
in that capacity. It was a general policy of the evaluation team to sug- 
gest means for remediation whenever they found project staff to be deficient 
in knowledge or skills they themselves indicated were of great importance. 
Documents used as part of this on-site training/ remediation effort can be 
found in the i^pendix of Volume IV. 
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Part 2 

An Analysis and Revision of 
School Personnel Utilization Program Objectives 

(Summary of Volume II, Parts 1 and 2) 

The official statement of goals and objectives of the School Personnel 
Utilization Program (SPU), Bureau of Educational Personnel Development, 
USOE, was the subject of the first evaluation study by the Evaluation Train- 
ing Center. The first step in the evaluation process was to determine 
the value of the goals and objectives as communication links between SPU 
program officials and local project personnel. The second step in the 
evaluation process consisted of a revision oi the goals and objectives in 
order to improve their communication function. 
The Communication Value of the Objectives 

Teachers, administrators, and college personnel who were directly 

associated with SPU projects, and a similar group who were not associated 

with SPU projects, were asked to respond to a written statement of each 

goal and objective on a modified version of a semantic differential. With 

this instrument respondents rated each objective en the following sets 

of bipolar adjectives: 

beneficial - harmful 

appropriate - inappropriate 

timely - untimely 

feasible - infeasible 

logical - illogical 

realistic - unrealirtic 

clear - unclear 
understandable - confusing 

meaningful - meaninglesa 

adequate - inadequate 

The adjective sets verc of two basic types — adjective sets relating to 

worthiness and appropriateness and adjective sets relating to clarity or 

confusion. This procedure results in a numerical value or score (for 
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1) Teachers and adtniniscracors Interact as equals 

2) Teachers s^rve part-cime as administrators 

3) Teachers* instructional activities are datennined by 
written goals 

* 4) Pupil achievement is a factor in evaluating teacher 
performance 

The experimental group was more in agreement with these statements 
Chan the control group, which was expected except in the case of the second 
item. 

Differences in responses were significant for 15 of the 31 items 
when the subjects were classified according to school position. These 
items were spreal out widely among the different categories of the con- 
ceptual model, and they related primarily to duties of teachers, evalua- 
tion of teachers, design of instruction, and the role of the public in 
educational process. There was greater agreement among groups on the 
items relating to the supervision of teachers, interaction of teachers 
administrators, employment practices, problem solving strategies, and 
get. In viewing the items as a whole, the administrators gave the higbesi 
percentage of responses in the expected direction, and the Qon-*teaching 
persomael seemed the most uacertain. Although most of tbe responses wc» 
in the intended direction, two items were answered in the **wrong directs * 
That is, more respondents agreed thso disagreed that teachers serving 
simultaneously as instructor and sdmlnlstrator, and tsachsrs autonomous!* 
sslscting thsir course topics wars rsprsssntatlve of flexible staffing 
(even though thess items wsrs intsodsd to rsprsssnt traditional practicms). 
In a survsy of ths gsneral direction of the differences between the exp»- 
mentsl snd control groups, it was demonstrated that the experimental gro^ 
ymlformly responded more "correct ly'* in their perception of whst 
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const iCuCed a tlt^xxbie sitafflog envlronnenc. Nonethej.^s6, a substantial 
majority of both groups v«re abl« to correctly discriminate between items 
consistent with differentiated staffing and those consistent with tradi-- 
tional staffing. 

Form 02 . Only seven of the comparisons between control and experi- 
mental groups on Form 02 revealed sifiUficaac differences & che «01 level. 
Tli#M differences v^re in Matements concerniag ^Mcher iailviduality. 
Interpersonal relat ions and conasmicMiett^ declaiw making and promotion 
and remuneration* In addition, 21 of the 31 itew revaalad algnificant 
differences among the varlaua school posi&a^ns. Owrall^ che adalni^tratorb 
sMmed to be the moat receptive toward fiaaslbla ataffin^ xancepts and the 
laaat racaptive to«Mrd traditional staffitf^ concapka. Tiiwirj of twenty- 
four itaas which daaonatratad significant differaMaa fall into the con- 
captual cacegories related to daciaion mahiag^ — M " recruitings 
praaotion* evaluation, raaunaration, and aacount^Wllty* OmLy one of the 
five itaae in the collagiAlity category iMaalad aignif li —i differences 
aMig school positioQ daaaif ications, and:naithar of thm tarn items in the 
ladividuallty category raaaalad such diffaaancas. 

In a survey of the gaaaral ''direction*' of the diffa— acaa batveen the 
axpariaantal aad control groupa* it vaa rleaaiiat rated that tfaa axparimantal 
groups consistaatly indicaud a greater wxllingaass to aask ia a flexible 
ataffing anviroaaent. Moraovw* in absolata terms, both graups indicated 
a preference for the flexikLa ataffing pattara character iaad hf these 

Aa^cts of Flexible Staffing 

The foregoing has comparad control and aaparteaatal grappa aad their 
parcaptioa and recaptivity tavaad the cansapa of flaaibla scaffiag* In 
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addition to this function the evaluation inst r ur.ents , Fcrnis 01 and 02, 
were designed to provide infomation about particular ways that those 
attenpting flexible staffing viftw the concept. 

tighty ^rcent uf the t«ach«rs and administrator* vurveyed agreed 
that teacher individuality la a key concept to flexible staff use and 
that provisions must be adopted alluving teachers u? sp«iJ.alize and work 
In areas of ^rsonal Mr«ngtk md compatence. On Form 02 a similar per- 
centage indicated they d«air«d co work in a aettij^ tffaere this was the 
case. 

RespQHM on Fona 01 iadlcaced that nearly ^.^.^itxy-f ive percent of 
the teachers and admioiatrators surveyed considered colla^ial decision 
neking to be central to the flexible staffing rnnrs^i Group problem 
•olvtn%^ aa opposed to unlleteral decision nakl v., wm coiiai.dered essen- 
tial. More than 75Z of teachers and administrators iAdlcAted that teachers 
and administrators in >e i acting ee equals with dlf femnt cesponslbllitles 
ie an Important c n a po Mw i t of f lartMe staffing. Elfbty-exx percent of 
keth groups responded n l^m 02 chat they were desirous of working in a 
school where this was the Mm. 

Both groups rejected the proopect of working In a school where 
iodivUuals did their Jobs ledependenrly of others on the staff. However 
em aoe^her quesdon 61Z of the teechoce reserved — t uiiuiiiji in selecting 
topics for their own couMee for olUA they were rooponsikle. It appears 
tiiny do not wloh to give mp the ooroHiey ohlch hmm mttmm psooided teachore 

ddnlAinamaore \mm artMK In choir dlsagmMK %fitli mm state- 
nent ^t rtMp «ouM mmmmm ■■■g nnH tlUy for plsnminn e f ionible 



staffing >ituaii>^r., arid ti»at Lea^r^tr^ Vwulj Jt/v^n. -^i: :.ti.r. 

^iitat> ^: yi^us. Nineiy-tvc pcrwtr.L x^ic i^ia wa^^ not a charac- 
teristic of iiv.-xible staf: use. Eighty-five p^'rctot#ot the teachers ^ur- 
vey*ed also Ci^^reed. A sirailat nc.T.bfer disag^^td w^th 'L^ »tatem^nt ihac 
most teacher* preferred to he cloMly supeivi^^d On Form 02 bcth grc^ups 
voiced a strT% dt^sire of yotkxz*^ xn a »cIi:^ol wher^ (acuity membeift tiave 
a greater mbm of reaponsibilxty t^x helping solve scbool problems, 
Elghty-slx percent of the faculty and admiDK^^aciv^ ra&poaaes indicated 
that this aiuttid be done by joint planning an^ ixpiexuentatlon by faculty 
ana admlnist-w i ve groups Ne<Arly a:i maay in^^cated thay wwuld enjoy 
vorking in a ;bituation vfaera inforoality was ^^vidant xn f aculty/adminstra* 
tive Inter-crr^^unications. 

Strong approval was given for the statement th^t flexible staffing 
requires a »ift in the assumption base underlying snany pats^micl pclicies. 
Nearly 85% ai the faculty and administrators ^tiSed that vichln a school 
staff. proh:jBB solving must proceed fros th« Asaamp^loa that teachers are 
creative asm: display ingenuity. Seventy^six p^rceoC of the teachers and 
85% of adiiii»t cators desired to work in a school wb^te this shift had 
occii'red. ^majority of both groups rejected the idea that detailed 
policies sha»ld regulate teacher behavior* 

Clghty-^ive percent of the teachers and ^^unistxAtecs umtm in agree- 
sent that tbNr cMcept of flexible scaffiog pr^^aJes lasMvice training of 
persocMl liktek vill Immi to locreaaed iostru^iMial rsspjusj^ility md 
IncresMd ■ a i 1 i» g| , Elghty^-^x percent Indicas^^ s to «mrk in a 

•ehool with m l — r vice program set up to ac^^pli^ ctesM mmm ends. 

The granpm mUk clomm to a uaanimous vac# vMpMi^ thst they cm* 
slder the ue« etf aidts mA classroM iastruct><^iiAL ^■Hf t ■ CMtral to 



the flexible aiai::n^ iJcu Fur 1 1 . r»:.. : ^ , ^: tLc iuawr»€r» and 81" or 

the administ racers uisi.ed wctk m u b.tuation uhcic paraprof essxonal 
assistance was available and u^c-d 

• Sevtiuy^one percent of Cue people auivcytd wculd like to see fully 
certified proteskicr.als employed part-M::.e i: th«> vi.hed. This might 
viewed an anaw^r to the wocb Ll.e cother wbi; wishes something 

less than a full*tiae comir.itrricnt • 

On two points th«>iii \Mas iitiriujs disagrceatt&t betwaen th« responses 
of faculty and adninistrators- While 835 of the admioiactators agreed 
that teachers denv^nst rat ing ex^^p: i^uc^i ikiil a:-.d axpartxae in instruc- 
tion should receive Inst r uct 1 gn«l re»pcasibilities and salaries above 
that of other teachers, only 473; of the teawhlng group vera of a similar 
opinion. Thirty percent were in dUagretnient and 235 ware uncertain. The 
other discrepancy occurred over the qaestioa of evaluation of teacher per* 
formance. Seventy-three perctnt of ch* adninistratcrs believed that in a flexi- 
ble staffing situation the. evaluation would be basac cn an assessment of 
one's pertorxnance by his subordinates, his pears, and his superiors in the 
organizational structure. Fifty-four per^^ni the teachers Agreed and 
46% were In disagreement or un;:trcain On Fotm 03, half of the teachers 
Indicated they would not like to work m a situation where this type of 
evaluation was in operat ion— threa-t vur ths ot the administrators favored 
working in this setting. 

Both administrative and faculty responses to statements ouggMtlng 
limited role differentiation and the continual movement of teachors 
Into administrative ranks were disappointing Only iOX of those sur- 
veyed Indicated they viewed flexible staffing as a structure in which one 
con really find a career in tea:;hiog without being forced loto 
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admlnlstrat ion. Only 30% saw the concept Incorporating extensive role 
differentiation which gom& beyond typical grades-level and subject area 
specialization. 

• Seventy*six percent of the administrative group and sixty percent 
of the faculty agreed that instructioDal activities are determined by 
written goals in the flexlU« staffing concept. Half of the teachers and 
two-thirds of the admlalssntors Indicated they would be desirous of work- 
ing in a school where this was the case. 

More than 90Z of both #roups agreed that accountability was an essen- 
tial element of the concept: of flexible staffing—that periodically school 
personnel must explain to parents the objectivss of the school, and the 
degree to which they are bcimg met. Eighty percent also agreed that flexi- 
ble staffed schools would ailt parents and the public for their opinion 
about school policy and objectives. 

Ninety-four percent of the teachers and administrators indicated on 
Form 02 that they wantad to mm A in a school where parents were informed 
of school objectives and the tetraa to which they ware being achieved. 
Eighty-five percent stated a daalra to work where parents and the public 
were ^sked to provide input iato the school's objective pool. 

Teachers were less in agraasMnt than administrators that student 
achievement, as a factor for rn—t deration in teacher evaluation, is a key to 
the concept of flexible mtMftiM^ Basty-elght percent of the teachers 
agreed comparad to 68Z of s^itHiairafrs. Whan asked whether they would 
be desirous of working In • m^kkmml %*mrm this factor of teacher evaluation 
was employed, only 43Z of tkm taachara answered they were, and 60% of the 
administrators ware positive IncliMd. A full 38Z of the teachers were 
opposed to working In that stCMtion casipared * with 24Z of the administrators. 
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It appears chac neither group is ready for the accountability issue which 

seems to be gaining more support from an eager public. 

B. A Status Study on Project Goals, Goal 
Priorities, and Goal Implementation 
(Summary of Volume III, Part 2) 

Essential to the assessment of the impact of the School Personnel 

Utilization Program was an evaluation of the goals upon which each project 

based its plans, processes, and activities. For this assessment it was 

necessary to determine first whether certain goals were included in each 

project, and second, to determine the priorities assigned to them by the 

project leadership. A logical ensuing step was a survey of the extent to 

which concrete efforts toward the fulfillment of project goals had been 

planned for and/or implemented. 

Method 

A prototype evaluation instrument for the criteria of goal importance 
and goal implementation was prepared using the Conceptual Model and the 
comprehensive set of SPU goals. This instrument underwent a series of 
formative evaluations by project directors, evaluation experts, and in- 
service school personnel, and the formative process resulted in a final 
instrument designated Form 03. 

Form 03 was sent to all the 23 SPU projects, and was administered 
to three major groups; project directors, project committees, and '*other" 
school personnel. Theee individuals responded to 27 goal statements by 
indicating the importance of each of the goals, and indicating the degree 
of implementation of each goal within their respective projects. The 
responses for each category were tabulated, and the means for each group, 
for each school » and for each item were calculated and analysed in two 
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Its were used to rank the goal statements in 
rder of the degree of implementation; and 
to de\ p an importance/implementation matrix. 

iteraents by importance . The ordering of the 
^ralizations. One obvious result was that 
lered the goal concerning the effective use of 
le existing structure to be very important. 
IS and clerks be used within the existing con* 
a somewhat disappointing response from those 
king alternative staffing structures. Despite 
le remaining eight goal statements selected to 
unittees focused on variables requiring changes 
il structure — those structures which are estab* 
imploy, retrains and retain human resources for 
id on variables of communication and hianen 

>ed around variables of evaluation and account* 
kwhat less enthusiasm» but nevertheless were 

category. 

»ls* planning connittees agree that Increased 
ihers toward students was a very important goal 
iept, the list of unimportant goals indicates 
le dimension of professionalism which places a 
control of the conduct and quality of the 
Professionalism in the fuller sense of the 
irtant component of the concept of flexible 



lnflu«nc« uf th« ISOL (vindlng gulJallnvs is ubvlous h*r«. It «pp««ri b.<th 
In th« go«l« which wvr« cho««n to b« iMplviMnCad, wall «• In which k^jU 
w«r« dcAiMd most Important In • fUxibla stafflnK andaavor, that project 
paraonnal wara kaanly awara uf tha structural aapacta of tha concapt. Plac- 
ing a ataff In a vartlcal hlararchy, with apaclallrad rolas, and davsloplng 
cooparatlva planning bodlaa within tha school saamad to taka pracadanc* 
ovar tha soclo-psycheloglcal consldaratlons. Ona might argua aftar compar- 
ing tha list of six Mat eoaiplataly Implamantad foals with tha list of 
alavan goals for which plana ara naarly complata, that tha tall Is wagging 
tha dog. Parhaps In an affort to fulfill contractual agraamants with tha 
funding sourca, or parhaps as • atratagy to racalva sacond or third yaar 
funding, projacts hava InpUnantad tarmlnal goala without having Implamantad 
tha nacasaary anabllng strataglas. For axanpla. It appaars that projact 
laadarahlp la attanptlng Ko aaCabllsh cooparatlva daclslen-naklng bodlas 
hafora Khay provlda a ataff additional training In Intarparaonal ralatlona 
•kills, and bafora Kh«y affact a change in tha clinata of ca—unlcatlon. 
Tanchars ara adapting naw titlas bafora Ch«y racalva training ra^ulrad of 
tha now job daacrlpKlon. In ndditlen, noat of tha projacta fait chat can> 
clniMus fnrnatlva avaluation wna aithnr vnry inpnrtMK or Inportanc, hoi#avar 
only onn proJacK cUina to ba nanlKorinf ita awn protraaa throvgh fomatlva 
•vnlunclva affort*. 

ffca iawlaq r mi |f ^ iMr tMuriMliwtitl — Mtrla . Ik* banic 
tmtm nf tiM Mtris taMUtn nf • crann CMUcion nf dM ragpanaaa nf cha 
fi«j«cK dirMtnra and tkm fnjnct aanniKCMa an • Mtrix canoiating of 
tht— MltHM rapraaantinc tha tkma lavala of gnnl infiananutlon, and 
ttiran tmn rapraaanting tha thr— lavala of t*«i inportanoa. 
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An «n«lyti0 u( ihm r«tpvn»v distribution dttncn»tr«t«d that thm 
r«0pont«» of th« project directors mor« oftvn viwtd thm important goAlt 
M Impltmsnttd, whil« th« C(>«mitt«« in«mb«r» f «n«r«l i.y vi«w«d th« •««!• 
goals M in th« planning stags. Ths rssults of an onsight validation 
atudyt in ifhich avidsncs of rsportsd implsmsntaiion was sought, claarly 
in4icatad that tha faculty typically undarastimatad tha laval of impla- 
Mntation of a goal, and tha projact directors typically ovarastimatad 
tha laplaMntation laval of tha goal. Most of tha goals fall within a 
"^tfaalrabla** staga of laplaMntation/importanca. 
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Part 4 

An Evaluation Paradlga for Floxlblo Staffing Patterns and Ita Application 
to tha Tampla City, Maaa, and Florida Natvork Projacta 

(A auMary of Volvima IV, Patta 1, 2, and 3) 

Tha evaluation modal propoaad In Voluma IV la a ganaral mo«laI vlth 
appllcatlona for tha evaluation of achool atafflng Inmivatlona aa vail aa 
curriculum and Inatructlont Starting vlth a general modal and than 
•laboratlng In tarma of a glvan Innovation haa valua In that it takaa In 
to account tha Impllcatlona of changing ona component vlthln a complex 
ayatam of Interdependent componenta. Even email Innovatlona cauae ripple 
affecta vhich are felt throughout the achool organlaatlon, and an evaluation 
muat be prepared to conalder theae larger effecta. 

Any planned change or Innovation, atafflng or otherviae, la a matter of 
taking certain concrete actlona on the baala of deliberate declalona vhlch 
Im turn reat on formal or Informal evaluatlona of a knovn condition and 
plaualble altaraatlvaa to that condition. Educational davelopera have been 
maklmg educational chaatea for yaara on an Intuitive, Informal evaluation 
baaa. Tha SPU evaluation paradigm attamtpa to formallae thla Intuitive pro^ 
eaaa amd combitm the relairance of the developer 'a ap^oach with the expll- 
cltmaaa amd rigor of the aclaotlflc approach. 

Tke tFO tvaluatlom Faradlgm placaa emphaala om formative evaluation aa 
amd rmf lacta a phlloaoplqr of avaluatlon mklch oUm 

1) Jhm ultimate puryoaa of avaluatlac* ia imf f uii e dducatiom 

2) raailitatiom of protram davelopmemt through formative evaluation 
ia more direct amd Immediate than through am approach of auama- 
tiva avaluatiem. 

3) Tha procaaa data collected in formative evaluation ia eaaentlal 
to the interpretation of product data gathered in the aummatlve 
avalmation. 



Th« SPU nodel cor:bjn»-s fonnatlvs «^ - 
asntary ttrattgl^s for • nltorlng Ch« ptu 
from Ch« old inttructiuuril process to Ch« 
•f f«QClv«n«00 and efficiency of the new 
and in comparison with a known standard. 

The Evaluation Training Center pers 
ciency and relative ef fectiveneee of deal 
the context of a general developmental mode 
aeaumee the following ae the salient steps 

1. Preplanning 

A. Status Study 

B. Goal Analysis 

C. Solution Analysis 

II. Planning and Development 

A. Derivation of objectives 

B. Establishment of criteria ami si^t*- ards 

C. Design of instructional m el t 

D. Design of plan for implemsNt fiiir ^ model 
£• Consistency analysis 

P. Feasibility study of the p^^ r implementing the model 
Design of formative evalua:--* che developmental and 
Implementation stage» auflW^ mluation at the opera- 
tional 0tage» field testit« m tte diffusion stage. 

H. Dasign of the dissemination srracegy 

III. Inaervlce training and orientation 

A. Knowledge 

B. Attitudes 

C. Skills 

IV. Installation 

A. Progress of program Implementation 

B. Problems encounterad in program implementation 

C. Dmfleianclea In the modal or plan for implementation 
0. Program effactlvenMS 

A. Program ef f ectlvmnaaa 

B. Pocumantation of alda af facta 

C. Coat analyala 



ive evaluation as compll- 
an educational transition, 
i ti»e assessment of the 
terms of global criteria 

^€ experienced the effi- 
a evaluation model within 

is developmental model 
"igram development: 



VI. 



Dlffualon 

A. Dlffualon 

B. Dlaaamlnatlon 



•nd 

for 



Ev«lu«f .^n Paradi* tor f iexlble staf* --i patT, i ns has. its 
t^*t ganer J«v«lopmaaiA- . t** i th« previous p«#» Each step ot 
^ t'l reflects a cormwr ^^lopmental tom^* 

Gg^ ^alyals is the firar the SFU design mnd focuses of the 

ymk iC SPU pioject goal- ^ ent here la tc mmlyze the goals 

project pmnommm ^r* nfornation relewt to goal revisions 
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n^^se or clarlt^' 
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Mi prlortrles Mtabl 

4 Process Ewslu^tion for 

step of tiM SPU 

pMcess of goal select 

> project pereennel are 

A) to what extent thtt«^ 
people; 



cation. Goals are 
T they reflect the 



and better 

lo determine 
-bv project personnel 

and declslon*-naklng makes up the 
!mu.aded la this step Is the analysis of 
declslon*maklng processes. In this 
• 4«termlne: 

caalooe are being made by the right 



T) to what extent th»* fmm^ timf Influence decisions; 

mmm^ ^^km to change their role In the 



Jl;) to what extMt 
decision pneese; 



of 
4mt 



^ the relative quallry of 
mm Model Eiraluatlon la mm 
lias staffing wmtml rtSTslaped ^ a 
ng whailM^ a modal 



lous decisions balmg made, 
the goal evaluation in Its analyaia 
Project. Here tiM concern vith 
• evaluating Itm atequatamaes 




vmriablaa, and 4amaftaplng a ^ofUim 
of ataff Inc vMAMaa common tm 
«0o imck to project lflmiMM% ami 



Ma naxt step of 



una 



component attempts to make explicit • ^ ^crr«o»4i^s and tecksicrues which 
project leaders mcend to use to Inst . cf^tr scmfflng mo^I. here the 
■odel focuses on the consistency of rn^ i^imr ' the model and with pro- 
ject goals. Also of Importance In this stie is le consld«r«rlca of the 
legality, legitimacy, the practlcmbllXty* ^ti tl balance cf the plan. 

The Evaluation of the Inatallaoi cftM as three maior objectlveiF 

1) to nooettor the Implementatiav mf laMallment :3^n 

2) to provide the Information wmmimi r anned decsalM^ during 
the Installation stage of daMlafDMs 

3) to document the extent of ±mtMXimnm vhlch has Tahii mlace. 
The Evaluation of Outcomes Ralairf Co $^ Attitude Sks^ s> and 

Projects Is a type of auoraatlve eiPaluaclM f c sing on pro^cts mf an laplc^ 
nented atafflng model at a given poinit v^rnm. These products m^e conaid- 
ered under ''our claaalf Icatlons: 

1) products related to atructural 

2) products related to staff ki 

3) organisational climate varlablav 

4) variables of unanticipated o 
TlMae four caMforias of ^riablas 

staffing pattenit aathority stx«ct 
tttdes and skills. In addition, thajr «<X1 
continued ienovatlaa, and indlcata Hm 
have resulted frosi the instsll—t of 
Application of ITU 



aacttudest 



skills 



U 



InfotMtion about tte 
pollclM mmd teachar 
iadiclaa of rhe cllBaan for 
probloM — bans firs ^aiilch 



InatriMMnta 
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on site visits in the Temple Cicy, Mesa, and Sarasota projects. These data 
ace reported in detail in Volume IV of this report. 

The Goal Analysis in TempleCity, Mesa, and Sarasota projects requirec 
mm use of four SPU Evaluation instruments: form 01 and 02 which describe 
:her perception and receptivity toward the flexible staffing concept, 
is 03 and 032 which indicates the project participant's priorities amoi^ 
goal statements on the form, and the degree to which these goals have 
taflv implemented in their projects. In addition, the participants' respon&t- 
caacerning their own school's needs are obtained and compared to the goal 
prterities and levels of Implementation. 

Decision Analysis covers the Important decisions made in each project 
fnn Its inception to date. Forms 08 and 08Q were used to obtain the decisisa 
aaUng data. 

The Model Analysis employs the use of Form 09. The profiles of the 
•tatting models developed for Mesa, Temple City, and Sarasota are listed; 
the strengths of each model as well as areas of model weaknesses are also 
Included. Tha model analysas for thaaa three- projects may be considered a 
statamant of project dirferencaa at tha modal davalopmant stage. 

Tha Analysis of tha: Ina t alia t Ion Plan Is tha least davalopad of tha 
SPU avaluatlon paradlgv steps, howavart by employing a strategy developed 
by tha ETC, an analysis was made of tha Tampla City Plan for Installing 
thalr modal of staff utlllsatloci. 

A variety of Inatnaants and pcocaduras was used to evaluate tha 
••it alls 1 1cm procaaa: Pocm 01 and 02 wmrm uaad to darlva a maaaura of staff 
at rt amiia and baaic ability to daal with tha concept of flexible staffing; 
tmm 03 vaa used to ohtaln toal isiplaaantatlon status data; and form 12 
^M^aaployad to ferret out praaaing problasM of tha installation process. 

Tha laat atap of tha SPU paradigm. Out coma Haasures , raliad heavily 
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on th r66 ETC developed InscrmMCCs , the 04, 05, xnd G" s^rift^* which ne^sure 
dte variables of self -concept , colxAwiallty, and profesMionalisn; Form 12, a 
^rmarrurcd intmviev concemioi. st^flng and struct ura. ^fSTxaiiAcs ^ and form 
CM, aaad here as a product ratber r^*n a process* iBensMn 



